Exponential complexity of an adiabatic algorithm for an NP-complete problem 
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We prove an analytical expression for the size of the gap between the ground and the first excited 
state of quantum adiabatic algorithm for the 3-satisfiability, where the initial Hamiltonian is a 
projector on the subspace complementary to the ground state. For large problem sizes the gap 
decreases exponentially and as a consequence the required running time is also exponential. 
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I. INTRODUCTION 



Quantum computation has attracted a lot of atten- 
tion after the discovery of Shor's quantum algorithm for 
factoring [ij. It requires polynomial number of steps 
while the best known classical algorithm is slower than 
polynomial. Another important quantum algorithm is 
Grover's search algorithm [2j which offers square-root 
improvement over classical search |24|. Quantum algo- 
rithms therefore seem to be qualitatively better than 
the classical ones. Obvious question is how much bet- 
ter are they? Classically problems can be split roughly 
into two groups, those whose solution requires polyno- 
mial number of steps and the so-called nondeterminis- 
tic polynomial (NP) for which no polynomial classical 
algorithms are known. Especially fine subclass of NP 
problems are NP-complete (NPC) ones. They have the 
property that solving a single NPC problem in polyno- 
mial time would immediately provide a polynomial algo- 
rithm for all NP problems. There are literally thousands 
of problems known to be NPC [3|, a paradigmatic ex- 
ample being the 3-satisfiability (3-SAT). The question 
of whether there exist polynomial algorithms for NPC 
problems is one of the great unsolved problems in math- 
ematics 0| • It is not known whether quantum algorithms 
can solve NPC problems in polynomial time. 

For quantum adiabatic computation, suggested by 
Farhi et.al. 0, Q, the initial numerical simulations 
for small problems suggested polynomial complexity for 
NPC problem. If proved to be a generic behavior this 
would be a major breakthrough. But even if the worst 
case scaling turns out to be exponential one could still 
have a significant improvement in the average case per- 
formance compared to classical algorithms. Subsequent 
numerical studies did not fully clarify the issue, some in- 
dicated exponential complexity 0, some polynomial [fl- 
it seems that the worst case performance is exponen- 
tial [j| but it might be nontrivial to identify this "hard- 
est" instances. On the theoretical side there are no rig- 
orous results about the complexity of quantum adiabatic 
algorithm for NPC problems. There are few exact calcu- 
lations of complexity for tailored problems 10] like e. g. 2- 
SAT instances HG3 (but note that 2-SAT is not NPC). 
Exact results are available though for adiabatic Grover's 
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00 13 Gl Recently a random matrix the- 
ory has been used to describe adiabatic algorithm Q 
even though it is not clear whether it applies to low en- 
ergy eigenstates For the discussion of the relation 
between the minimal gap A and the necessary running 
time see also [l6j . 

In the present paper we are going to prove an analytical 
formula for the size of the gap, thereby also of the com- 
plexity, for a particular implementation of the quantum 
adiabatic algorithm for 3-SAT, where the initial Hamil- 
tonian is a simple projector. Section[H]is the core of the 
paper and gives a derivation of the gap. 



II. ANALYTICAL CALCULATION OF THE 
GAP 

We will choose a linear interpolation between the initial 
and the final Hamiltonian, 



H(t) = (1 - t)H(0) + tH(l). 



(1) 



The initial Hamiltonian will be a projector to the space 
complementary to the single ground state \tp), 



ff(0) = 6(l-|V)W). 
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where b — fi^zr 



and N — 2™ is the dimension of the 
Hilbert space. We choose this "strange" value of b in 
order to have tr[if(0)] = An/2. The final Hamiltonian 
is a sum of m three qubit projectors, one for each clause 



H(l) = aJ^PiHCi 



(3) 



with a = — , a — rain and m and n are number of clauses 
and variables, respectively. Final Hamiltonian counts the 
number of violated clauses and can be realized using 3- 
local Hamiltonian. Despite two parameters the Hamil- 
tonian H(t) depends essentially on a single parameter 
1/7 := a/b w 8/(na) = 8/m. 

Our goal is to calculate the minimal energy gap A 
between the ground and the first excited state of H(t). 
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First, we are going to use the symmetry of the system to 
reduce the eigenvalue problem for an exponentially large 
matrix H(t) to the eigenvalue problem of a matrix whose 
dimension will grow only linearly with n. 

Let us consider a fixed 3-SAT instance, i.e. having 
a certain H(l). Let D be the largest number of vio- 
lated clauses by that instance. The final Hamiltonian 
has therefore eigenenergies Ej(t = 1) = ja with degen- 



polynomial along lines Ej is always nonzero, p(sj,t) = 
-(1 - t)b{at) D {D - jy.j\(-iydj/N. Therefore, due to 
the continuity of eigenvalues E(t) of H s (t) no eigenvalue 
can cross any of the lines Ej = (l — t)b+jat. At time t = 1 
we know that the eigenvalues are Ej(l) = ja. Further- 
more, because the derivative dp(ej,l)/dX = —a D (D — 
j)\j\{— \y has the same sign as p(£j,t — > 1) the eigen- 
values approach ja from below as t — > 1. Therefore, 



eracies dj,j = 0,...,D. First, note that the Hamiltonian j-th eigenvalue of H s (t) is bounded by Ej-i and Ej 



H(t) is symmetric to any permutation of states that have 
the same final energy Ei(l). Let us denote the state that 
is symmetric combination of all dj states with final en- 
ergy ja by \j) s , \j) s = -j=J2 Ek {i)=ja \ k )- We s P Ht N 
dimensional Hilbcrt space into D + 1 totally symmet- 
ric states |j) s and N — D — 1 antisymmetric states or- 
thogonal to D + 1 totally symmetric ones. Because the 
initial ground state \ip) is totally symmetric we immedi- 
ately see that all matrix elements of H(t) between totally 
symmetric and antisymmetric subspaces are zero. What 
is more, the eigenvalues of the antisymmetric states are 
readily written down, E^ ntl = (l — t)b+jat =: Ej, and are 
(dj — 1) times degenerate, j — 0, . . . , D. To determine 
the minimal gap A we therefore have to solve the eigen- 
value problem only for a D + 1 dimensional submatrix 
on the space of totally symmetric states \j) s instead on 
the full exponentially large Hilbert space. On the totally 
symmetric subspace the matrix H s (t) (H(t) limited to 
the totally symmetric subspace) of the Hamiltonian has 
a simple form, 



H s (t) = diag(e) - (1 - i)6xx 2 



(4) 



- 1 dimensional column vector 
. , y/do/N) T occurring in a pro- 
t)b + jat are the elements of the 



with a normalized D - 

X= (y/dtfN, y/dJN,.. 

jector xx T and Ej = (1 - 
diagonal matrix diag(e). We are now going to determine 
the gap for matrix H s 

The characteristic polynomial p(X) = det (H s (t) — Al) 
can be explicitly evaluated |25|. 
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p(X,t) = l[(e j -X)-(l 



j=0 fe/j 



(5) 



The calculation of the minimal gap A will now proceed in 
two steps. First we will prove that the region around the 
minimal gap is empty of other close eigenlevel encoun- 
ters, meaning that sufficiently close to the minimal gap 
the geometry is that of a 2-level avoided crossing. The 
characteristic polynomial p(A, t) has therefore parabolic 
shape around i m i n , the location of the minimal gap. In 
the second step we will determine A by simply calculat- 
ing derivatives of p(X,t) at t m { n , fitting a parabola, and 
thereby obtain the gap with exponentially small relative 
error. We will always assume that the degeneracy do of 
the ground state is small, do <C N, so that we will be able 
to neglect exponentially small terms of the form ~ do/N. 

Let us show that the avoided crossing is really iso- 
lated. First observe that the value of the characteristic 



i.e. 

(1 - t)b + {j - l)at < Ej(t) < (1 - t)b + jat. This has 
two consequences: (i) if the gap A -C a the ground state 
avoided crossing will be isolated from 2?2(t) an d (ii) the 
line £o = (1 — t)b passes through the gap A, i.e. between 
Eo(t) and E\(t). From our result we will see that we 
indeed have A <C a, meaning that the avoided crossing 
is isolated. The second point above will be used in the 
following to determine the location i m j n of the minimal 
gap. This will be obtained by remembering that in the 
2-level crossing the first derivative of the characteristic 
polynomial changes sign at the crossing. Demanding a 
zero of dp/dX on the line A = Eq will give us an equation 
for t m ; n while the second derivative d 2 p/dX 2 will be used 
to calculate A. 

Using ||SJ| we can calculate the determinant, 
p(E ,t)/((at) D D\) = -(1 - t)bd /N, and its first 
and second derivatives, all evaluated along the line 
A = £ Q = (!-*)&, 



dp{£ 0l t)/dX 

d 2 P (E ,t)/dx 2 

{at) D ~ 2 D\ 



-af+(l-t)6[7_i + &i 



2ath D - (1 - t)b[2-f^h D + 2 7 _ 2 - 
9D% (6) 



N D 



where hp := ^ i=l 1/i and go ■— Si=i I/* 2 - Two other 
important coefficients that are functions of size n and 
depend on the 3-SAT instance in question are 



7-i 



i=l 



7-2 



Ni 2 



(7) 



The sum d%i is given by the trace of H(l), J2iLo 

tr[£f(l)] = 7 w Enforcing that the first deriva- 
tive of p(A, t) vanishes at t m { n and neglecting exponen- 
tially small term involving d /N we obtain, 
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77-i 
1 + 77-i 



(8) 



Note that because the gap A will turn out to be ex- 
ponentially small, the error of so calculated i m i n is also 
exponentially small. We now determine the two lowest 
levels Eq and E\ at t m \ n by parabolic fit to the values of 
determinant and its first two derivatives ©, obtaining 

A = -El(tmin) — -Eo(imin), 



n\[d~Q 



2VN 



f(n), f(n) = 




1 + 77-1 
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where we used the asymptotic value 6«n/2 and we ne- 
glected all terms of relative size 0(1/N) (i.e. involving 
do). This is the main result of the present paper. It 
gives an explicit expression for the gap A in terms of two 
coefficients 7_i and 7_2 (0). By evaluating the values 
of the determinant and its first derivative at the so ob- 
tained A = Eq^i one can verify that the error in f(n) is 
O(do/N). Relative precision of A is therefore expo- 
nential. To preserve this accuracy we have to demand 
that the ground state degeneracy d does not increase by 
increasing n, i.e. the number of solutions is kept con- 
stant. 

How do 7_i and 7_2 behave as n increases? The coef- 
ficients di/N can be viewed as a discrete probability dis- 
tribution, 7_i and 7-2 as negative moments and 7 as the 
first moment. Let us denote by a the standard deviation 
of this distribution, a := -^72 — 7 2 , with 72 — ^2 dii 2 /N . 
Then, if with increasing n the ratio (7/7 goes to zero suf- 
ficiently fast (i.e. the distribution becomes narrow), the 
inverse moments will be in the leading order given just 
by the inverse powers of the first moment, 

1 -i = -+0(l/n 2 ) 7_ 2 = \+0(l/n*). (10) 

7 7 

For random 3-SAT with constant a one can show j2|| 
that one indeed has cr/7 ~ l/s/n. We can therefore 
see that the function f(n) will for large n behave as 
f(n) = 1 + ©(I/ti) for arbitrary random 3-SAT. Note 
though that this does not mean that the gap is expo- 
nentially small for arbitrary random 3-SAT. For A to be 
small we also have to keep the number of solutions con- 
stant. For instance, below the transition point a c ~ 4.25 
the number of solutions for random 3-SAT grows expo- 
nentially with n (see e.g. Ref. 01) an d therefore our 
formula for gap © can not be used to predict the scal- 
ing for n — > 00. 

In the next Section we are going to demonstrate the 
validity of Eq.[5]by numerical calculations. We are going 
to consider two ensembles of 3-SAT instances having a 
single solution, do = 1. The first one will be the so-called 
single-solution random 3-SAT ensemble whose members 
seem to be hard also for classical algorithms [l7|. The 
second ensemble of 3-SAT instances, called binomial 3- 
SAT, is generated in such a way that the degeneracies dj 
are explicitly known, enabling analytical calculation of 
7_i and 7_ 2 . 



III. NUMERICAL DEMONSTRATION 

To illustrate the theory we numerically calculated A 
for single-solution random 3-SAT instances with a = 4.5 
and compared this with the theoretical prediction for A, 
Eq. |J3J. Because the accuracy of Eq. I© is exponential in 
n one can hardly see any difference between the theory 
and numerics in Fig. ^ ( e -9- f° r n = 20 the two agree 
to 3 decimal places!). Note that for random 3-SAT we 
do not know explicit form of degeneracies dj so we had 
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FIG. 1: Single-solution random 3-SAT with a = 4.5. Empty 
squares are numerically calculated gaps, full circles (overlap- 
ping with squares) is the theoretical formula © (with numer- 
ically calculated 7-1 and 7-2). Dashed line is l/(2y/W). 



to calculate 7-1 and 7^2 numerically. For instance, for 
11 = 30 we have 7-17 ~ 1.05 and 7-27 2 ~ 1.17, result- 
ing in /(30) ~ 0.95, see also data in Fig. |3 To remedy 
this drawback of having to numerically calculate 7_i and 
7_2 we have constructed another set of 3-SAT instances, 
shortly binomial 3-SAT, for which dj are given by the 
binomial distribution and therefore we can explicitly cal- 
culate 7_i and 7-2- 

The prescription to construct binomial 3-SAT is the 
following. Assume that n is divisible by 3 and denote r = 
n/3. We split n qubits into r triples and for each triple we 
add 7 different clauses involving this three qubits (out of 
8 possible). In total we therefore have m — 7r clauses, so 
the clause density is a = 7/3. The degeneracies of such 
binomial 3-SAT are di = 7* (^) , i = 0, . . . , r. For binomial 
degeneracies one can express 7_i and 7-2 in term of a 
generalized hypergeometric function, 



_ 7r /1,1,1-r _ 

7-1 - 22 ;-' 

7-2 gr 3^4 I 2 2 , 



(11) 



While this expressions are exact they are not very il- 
luminating. We are particularly interested in large n 
behavior. Using asymptotic expansion [l9l | one gets 
7 _! x 1(1 + ± + ■ ■ ■ ) and 7-2 ~ £(1 + £ + ■••), 
resulting in f(n) x 1- g-, where X denotes asymptoti- 
cally equal. To demonstrate our explicit result I© in the 
case of binomial 3-SAT (|llfl we again performed numer- 
ical calculation. The results are shown in Fig. This 
time we rather show f(n) as the plot for A would look 
very similar to the one for single-solution random 3-SAT 
in Fig. ^ I n the lower frame we can see that the accu- 
racy of theoretical f(n) © is indeed exponential. Note 
that binomial 3-SAT is rather artificial and easy to solve 
classically, we use it just to demonstrate our theory. The 
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FIG. 2: Binomial 3-SAT. Full circles are theoretical predic- 
tion for f(n) using Eq. 1111 . empty squares (overlapping with 
full circles) are numerical result for full diagonalization. In 
the bottom figure we show for the same data the difference 
between the theory and the numerics. Dashed line is 1/2™. 
For comparison we also show in the top frame f(n) (obtained 
by numerically calculating 7_i and 7-2) for three different 
single-solution random 3-SAT ensembles (stars and triangles). 



same expression for the minimal gap as here for the bi- 
nomial 3-SAT has been obtained also for the adiabatic 
Grover's algorithm in [j| where a similar symmetry as 
here has been exploited. 



IV. DISCUSSIONS 

Our result shows that asymptotically the gap scales 
as A x n/(2y/N) for an arbitrary random 3-SAT (with 
constant do)- This means that the running time grows as 
~ V~N, the same as for Grover's algorithm. In Ref. 0] 
it is proved that the running time of any Grover's al- 
gorithm of the form H = \w)(w\ + Hr>{t), for an arbi- 
trary Hu{t), must be larger than ~ y/N. Farhi et. al. 
have pointed out [2fJ that the proof can be straightfor- 
wardly extended to Hamiltonians of the form H(t) — 
(1 - t/T)(l - \w)(w\) + (t/T)H(l) {i.e. of the form we 
use) to show that: demanding that after time T we reach 
the ground state of H(l) from any of the basis states 
\w) {i.e. averaging over a complete basis is used in the 
proof), the running time T must be larger than ~ >/~N. 
What does this tell us about the running time for a single 
specific choice oi \ w) = \ip) that we use? Provided one is 
able to show that there exists a basis, a member of which 
is our for which the running time is the same for all 
members \w) of that basis (or at least scales the same), 



would mean that the running time must necessarily be 
larger than ~ y/~N also for specific \w) = \tp), i.e. the 
gap must be smaller than ~ 1/y/N. Without showing 
this nothing can be concluded about the running time 
for a particular H{t), not even about the average run- 
ning time. But fortunately, such a basis can be found. 
It consists of eigenvectors of cr x operator. In z-eigenbasis 
that we use, all such basis states are sums of all compu- 
tational states with the signs in front of them depend- 
ing on the eigenvalue of c x , \w) = {1/VN) J2 i signji), 
with sign^ = ±1. For instance, for our l^) @ we have 
sign i = 1. One can now quickly see that the same sym- 
metry arguments used in the derivation of Eq.0]for state 
\ip) can be used also for other \w)'s of the above form. In 
particular, the eigenvalue problem can be reduced to the 
very same matrix H s {t) Q for each of |io)'s. This then 
shows that if one uses for |u>)'s the eigenstates of a x oper- 
ator the running time is the same for all. Using the above 
mentioned proof one can then conclude that the running 
time must be larger than ~ \fN also for our choice of 
\w) = \ip) which is in accordance with our explicit result 

©■ 

It is interesting to note that one can obtain the asymp- 
totic dependence of A x n/{2^/N) already by project- 
ing the Hamiltonian H s {t) to a 2-dimensional subspace 
spanned by state \tfj) and the solution state |0) s . The 
reason for the Grover-like scaling of A for large n is that 
the lowest two levels become effectively decoupled from 
the rest of the spectrum. This "decoupling" arises be- 
cause the couplings dj/N (for fixed j) go toward zero by 
increasing n. Note though that our result for A @ is 
nonperturbative, i.e. one can not obtain function f{n) 
by perturbative corrections to the asymptotic result, e.g. 
by perturbatively including higher levels. 

Is this asymptotic square-root behavior of quantum 
adiabatic algorithm for 3-SAT general, i.e. independent 
of our choice of H{0) or of the interpolating path? Here 
we will discuss only the effect of different choices of H (0) 
although the choice of optimal path is also important, for 
an example when the choice of the path matters see [22| . 
Important is to distinguish between the average-case and 
the worst-case performance. For the average-case perfor- 
mance numerics clearly shows that our choice of H{0) 
is less than optimal. For instance, taking for H{0) a 
sum of terms 1 — er x , one for each qubit, the average 
gap is usually much larger than ~ 1/^/N. The situa- 
tion is on the other hand different if one considers the 
worst-case performance. Numerical calculations of A for 
H (°) = Ei(l-<7x);, see Refs. [1 EH, indicate that 
the gap for single-solution random 3-SAT instances with 
small a {e.g. a = 3) shows dependence similar to the 
square-root asymptotic formula derived in the present 
paper. In Ref. |15| where exactly the same normaliza- 
tion of the Hamiltonian as here is used the asymptotic 
dependence of A is exactly A x n/{2^/N), i. e. without 
any fitting prefactor. Therefore, there are numerical in- 
dications that the worst-case performance could be the 
same ~ 1/%/iV also for other choices of H{0) while on 
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the other hand the average-case performance might be 
significantly better [23. A distinctive feature of single- 
solution 3-SAT instances with small a that seems to play 
a role in this square-root behaviour of the gap is that 
the number of statements (states) that violate only one 
clause is exponentially large (though still exponentially 
smaller than N). That is, -ff(l) has a single ground state 
and at the same time exponentially degenerate first ex- 
cited state just above it. Adiabatic algorithm therefore 
has to "find" the right ground state among exponentially 
many that are "almost" ground states. P. Shor also pre- 
sented an informal mathematical argument why one can 
expects the worst-case performance for NPC problems 
to be the same as that for searching in an unstructured 
database |2lj . 

In conclusion, we have provided an analytical expres- 
sion for the minimal gap of a particular implementa- 
tion of the quantum adiabatic algorithm for 3-SAT. 



The derivation shows that such adiabatic algorithm is 
asymptotically equivalent to searching in an unstructured 
database. Numerical calculations hint that the same 
asymptotic worst-case performance might be obtained 
also for other choices of initial Hamiltonian. 
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